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Combined best effort and contention free guaranteed throughput data scheduli; 

112002 



The present invention relates to a data switching device comprising inputs for 
guaranteed throughput and best effort data, outputs, a data switch intercomiecting the inputs 
and outputs, guaranteed throughput control means coupled for controlling a guaranteed 
throughput data scheduling and best effort control means coupled for controlling a best effort 
data scheduling. 

The present invention also relates to a data switching method. 



Such a data switching device and method are known &om US-2001/0033581 
Al . The Icnown data switching device comprises input buffers for data in up to four qualities 
of service classes. For example there are input buffers belonging to the so called Guaranteed 
Bandwidth -also called Guaranteed Throughput (GT)- class and the Best Effort (BE) class. 
The known device forther comprises output buffers also for each class separately, a data 
switch interconnecting the input and output buffers for each and every class, and GT data 
control means and BE data control means for controlling the GT and BE data scheduling 
respectively of input data packets. In an embodiment of the known device the control means, 
apart from conducting a form of priority control for reading order control, conduct a 
contention control at least for data belonging to the GT class. In a detailed embodhnent also 
meant for carrying out contention contixil the BE data scheduling is performed after the GT 
data scheduling, whereby the BE data scheduling is based on input lines and output Unes that 
have not been selected by the scheduhng of data packets of the guaranteed bandwidth class. It 
is a disadvantage of the known data switchmg device and method that the multiplicity of 
classes, priorities, input as well as output buffers for each class separately lay a huge burden 
on the software and processor controUed hardware necessary for controlling, avoiding 
contention and scheduhng the variety of classes of data. 



It is an object of the present invention to provide a sin^lified data switching 
device and method, which aUeviate the burden on required soft- and hardware. 
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Thereto the switching device according to the invention is characterized in that 
the guaranteed throughput and best effort control means are arranged for a combined control 

such that the best effort data scheduling is based onacontention free guax^teedthrough^^^ 
scheduling. 

5 It is an advantage of the switching device and method according to the present 

invention that it is found that starting from a contention free guaranteed thxx^ughput data 
schedule as a basis for the best effort data scheduling, the guaranteed throughput data C30 
schedule simply fonns a boundary condition for the best effort data scheduling. This way the ^ 

8"^t^dthroughputandbesteffortscheduIingarecombined.Theborderconditionthen ^ 
10 only mvolves a one step reservation ofinput and output hues. Hus saves the burden of ^ 
hardwa^ and software and confrol in the data switching device, but also shortens the latency 

whichisdefinedasthetimeadatapacketspendsinthedataswitchingdevice.Furthemxore ' R 
no, more or less soft priorities have to be defined and processed, which saves even more W 

^<>*^^>l^^ware. and associated control in the data switching device according to the O 
15 mvention. q 

data switehing device acconimg to Iheinveoaon. the ^ 
dau switching device ha. at least one guaranteed througl^ut iq,ut buffer for at least one data 

switch input 

This embodiment provides improved flexibility as to the particular choice the 
numbers of guaranteed throughput input buffers per data switch mput(s). 

In a further embodiment of the data switching device accoixling to the 
mvention, the at least one guaranteed throughput input buffer is one deep. 

The guaranteed throughput data scheduling may be considered as a fixed 
boundary condition having absolute precedence over the best effort scheduling, without 
additional waiting, m fact the guaranteed throughput data switching then behaves like a 
pipelined circvut 

In a fiirther embodiment of the data switching device according to the 

invention, the data switching device may have one and the same output buffer both for 
coUectmg guaranteed throughput and best effort data. 

Advantageously no separate input buffers and output buffers are required for 

both^egu^anteed throughput and best effort related data, although both types of data^ 
routed sqjarately througji the data switch. 

In a further embodiment of the method according to the invention, the best 
effort scheduling is perfomied after the guaranteed throughput scheduling. 
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The scheduling of guaranteed throughput and best effort may be perfonned 

sequentially. 

Advantageously in a still further embodiment of the method according to the 
invention the guaranteed throughput data schedulmg only takes one step. The one step may 
5 even simply involve the reservation of inputs and outputs of the data switch. 

In another further embodiment of the method according to the invention, the 
best effort data scheduling takes one or more multiples of three steps, including the steps: 
request, grant and accept. 

The set of three steps, if repeated one or more times may lead to an improved 
10 data scheduling. 

It is further advantageous if a contention resolution for said best effort data 
scheduHng is based on for example bipartite graph matching. 



present the data switching device and method according to the invention 
wiU be elucidated further together with their additional advantages, while reference is being 
made to the appended drawing, wherein shnilar componaits are being referred to by means 
of the same reference numerals. In the drawing: 

Fig. 1(a) shows an schematic view of a relevant part of the data switchmg 
20 device according to the invaition; 

Fig. 1(b) shows the relation between inputs and outputs of a data switch for 
application in the data switchmg device of Fig. 1 (a) in an exemphfied so called bipartite 
graph; and 

Figs. 2(a), 2(b), 2(c) and 2(d) shows various phases of the exempUfied 
25 bipartite graph of Fig. 1(b). 



In present day systems-on-chip and network-on-chip architectures there is the 
challenge of managing the complexity of designing chips containing biUions of 
30 semiconductor components. Mainly because of costs and bandwidth reasons wires and busses 
are no longer suitable for dealing with the dynamic communication required in those 
architectures. Communication services, like for example guaranteed services or Best Effort 
(BE) services offer an intercomiection through a data switching device 1, such as shown in 
fig. 1(a). An example of guaranteed services is C5uaranteed Throughput hereafter abbreviated 
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to GT, also known as Guaranteed Bandwidth, GT services require resource reservations for 
worst case communication scenarios, whereas BE services can be used for less critical data 
communication, but do not provide guarantees in terms of throughput At the other hand BE 
data traffic may have a better average communication performance than offered by 
5 guaranteed services. Both GT and BE services are required in a present day flexible data 
switching device 1 . 

As shown in figure 1(a) the data switching device 1 comprises input buffers 2 
and 3, and output buffers 4. Input buffers 2 are meant for GT data and input buffers 3 are 
meant for BE data. In a device (not shown) input data may be separated in GT and BE data. 

10 The input buffers 2 and 3 are coupled between schematically shown demultiplexers, 

indicated DEMUX, and multiplexers, indicated MUX. The data switching device 1 fiarther 
comprises a data switch 5, also called for example a crossbar switch, router switch or 
switching matrix, interconnecting the input buffers 2, 3 and output buffers 4. In addition the 
data switching device 1 comprises scheduling control means 6, indicated CONTROL coupled 

15 to said input buffers 2, 3, and to the output buffers 4, and to the data switch 5. A part of the 
scheduling control means is GT control means 6-1 for controlling the GT data scheduling of 
the data switch 5 and another part of the scheduling control means is BE control means 6-2 
for controlling the BE data scheduling of the data switch 5- Every time the scheduling results 
in absence of contention on either the input buffers 2, 3, or the output buffers 4. Contention, 

20 refers to the occasion wherein multiple data items simultaneously request a same input II ,,14 
(=input contention) or a same output 0L.04 (^output contention) of the data switch 5, 

Starting point of the GT scheduling is such that it is presupposed that a GT 
data switching schedule is itself firee of contention. Because the scheduling normally involves 
three phases or steps, which will be elucidated later, that is the request, the grant and the 

25 accept step, advantage can be taken fi-om the contention free GT scheduling by the fact that 
these three steps reduce to one GT reservation step, which precedes tiie three BE scheduling 
steps. Thus the GT scheduling followed by the BE scheduling advantageously only takes four 
steps all together. In particular the GT and BE control means 6-1 and 6-2 are arranged for a 
combined control such that the BE data scheduling is based on the contention firee GT 

30 • scheduling. This saves both hardware and software scheduUng control. Due to the GT being 
contention firee, also at the output 01..04 and output buffers these output buffers 4 for GT 
and BE may be one and the same ou^ut buffer 4, The GT input buffers may be chosen to be 
only one deep, which again saves both hardware and software scheduling control, and also 
minimizes latency of the GT data. 
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An example will explain the combined or intertwined scheduling of GT and 
BE. Suppose as exempHfied by Figs. 1(a) and 1(b) for ttie purpose of this simple example, 
ttiat the arity of the router switch 5 is four, that is the switch has four inputs, numbered II. ,14 
and four outputs, numbered 01.,04. The scheduling is such that the GT control means 6-1 
first reserve a GT connection lets say between input 13 and output Ol, as shown in Fig. 2(a). 
A situation indicated by crossed BE input buffers 3, meaning that the buffers 3 are filled with 
data, as schematically shown in Fig 1(a), would result in a so called bipartite graph for the 
BE scheduling as shown in Fig 1(b). For example 3,2 in input buffer 3 means that a data 
connection from input 13 to output 02 is wanted. At the side of irq)ut II three BE input 
buffers 3 would request data communication to outputs Ol, 02 and 03. Input T2 does not 
show any request Input 13 would request data communication to outputs 02 and 04, and 
input 14 only requests data transfer to output 04. Due to the contention free GT scheduled 
connection -indicated by an encircled 1 - any BE request from input 13 to any output is 
disabled. Hiis means that in the request step the BE requests from input 13 to outputs 02 and 
04 are being ignored, which simplifies the BE scheduling, because a smaller amount of 
iiq)uts have to be taken into account during the BE request phase. The next step is the grant 
step, wherein first any BE grant from output Ol to any input is disabled, which again 
simplifies the fiirther BE scheduling, because a smaller amount of outputs have to be taken 
into account for the BE scheduling during the BE grant phase. The then next step is the BE 
accept step, where by way of example the data connection between output 02 and input II is 
accepted. Thereafter the actual GT and BE data communication may be effected. The triplet 
of the steps Request, Grant and Accept may be repeated one or more times, in order to 
improve the scheduling further. 
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1 . A data switching device comprising inputs for guaranteed throughput aad best 

effort data, outputs, a data switch interconnecting the inputs and outputs, guaranteed 
throughput control means coupled for conhroUing a guaranteed throughput data scheduling 
and best effort control means coupled for controlling a best effort data scheduhng, 
characterized in that the guaranteed throughput and best effort control means are arranged for 
a combined control such that the best effort data scheduling is based on a contention free 
guaranteed throughput scheduling. 

2. The data switching device according to claim 1 , wherein the data switching 
device has at least one guaranteed throughput input buffer &r at least one data switch input 

3. The data switching device according to claim 2, wherein flie at least one 
guaranteed throughput input buffer is one deep. 

^- "I^e data switching device accordmg to claim 2, wherein the data switching 

device has one and the same output buffer both for collecting guaranteed throughput and best 
effort data. 

^' ^ switching method, wherein guaranteed throughput and best effort data 

is scheduled for switching, characterized in that the best effort data scheduhng is based on a - 
contaation free guaranteed throughput data scheduling. 

6. The method according to claim 5, characterized in that the best effort 

scheduling is performed after the guaranteed throughput scheduling. 

^- The method according to claim 5, characterized in that the guaranteed data 

scheduling takes one step. 
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8. The method according to claim 7, characterized in that the one step involves a 
reservation of inputs and/or outputs. 

9. The method according to claim 5, wherein the best effort data scheduling takes 
one or more multiples of three steps, including the steps: request, grant and accept 

1 0- The method according to claim 9, wherein a contention resolution for said best 

effort data scheduling is based on bipartite graph matching. 
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ABSTRACT; 

HPO"DGt 

A data switching device has inpnis for Granted Tbxiughput (GT) and B^r 
Effort (BE) data, ou^uts, a data switch interconnecting the inputs and outputs, GT control 
means for controlling the GT data scheduling and BE control means for controlling the BE GS 
data scheduling. The GT and BE control means are arranged for a combined control such that S 
the BE data scheduling is based on a contention free GT scheduling. 

Fig. 1(a) S. 
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